Incremental Generation of Multimodal Deixis Referring to Objects
نویسندگان
چکیده
This paper describes an approach for the generation of multimodal deixis to be uttered by an anthropomorphic agent in virtual reality. The proposed algorithm integrates pointing and definite description. Doing so, the context-dependent discriminatory power of the gesture determines the contentselection for the verbal constituent. The concept of a pointing cone is used to model the region singled out by a pointing gesture and to distinguish two referential functions called object-pointing and region-pointing.
منابع مشابه
Issues for the Generation of Document Deixis
In this paper we describe issues for the computational generation of references to document parts such as sections, pictures, paragraphs etc, which we call document deixis. We discuss the circumstances under which these references need to be used in place of ordinary referring expressions and a number of problems in their generation. We also sketch a preliminary proposal for document deixis gen...
متن کاملReferring Via Document Parts
Documents in a wide range of genres often contain references to their own sections, pictures etc. We call such referring expressions instances of Document Deixis. The present work focuses on the generation of Document Deixis in the context of a particular kind of natural language generation system in which these descriptions are not specified as part of the input, i.e., when it is up to the sys...
متن کاملSelective Analysis of Linguistic Features Used in Video Mediated Collaboration: An Indicator of Users Sense of Co-presence
Studies in video mediated collaboration are going beyond traditional measures of time on task and task accuracy by attempting to qualify specific aspect of users’ experience. This paper explores users’ sense of co-presence as the extent to which they feel co-present with their partner when building collaboratively a toy over a video conferencing system. A linguistic analysis of the way users ar...
متن کاملWhat and Where: An Empirical Investigation of Pointing Gestures and Descriptions in Multimodal Referring Actions
Pointing gestures are pervasive in human referring actions, and are often combined with spoken descriptions. Combining gesture and speech naturally to refer to objects is an essential task in multimodal NLG systems. However, the way gesture and speech should be combined in a referring act remains an open question. In particular, it is not clear whether, in planning a pointing gesture in conjunc...
متن کاملTowards Generation Of Fluent Referring Action In Multimodal Situations
Referring actions in multimodal situations can be thought of as linguistic expressions well coordinated with several physical actions. In this paper, what patterns of linguistic expressions are commonly used and how physical actions are temporally coordinated to them are reported based on corpus examinations. In particular, by categorizing objects according to two features, visibility and membe...
متن کامل